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Abstract 



This white paper provides an overview of the first generation G igabit Ethernet (G bE) Interconnect Kit 
options for the ProLiant BL p-C lass system. Each G bE Interconnect Kit includes a pair of industry- 
standard Ethernet switches that dramatically reduce the number of Ethernet network cables attached to 
the rear of the ProLiant BL p-C lass server blade enclosure. 

The intended audience for this paper includes engineers and system administrators familiar with the 
overall network design of the ProLiant BL p-C lass system. For readers not familiar with this overall 
network design, please see the ProLiant BL p-C lass N etworking 0 verview ^hite paper. 

Introduction 

The HP ProLiant BL p-C lass system includes a portfolio of ProLiant BL p-C lass server blades, the p-C lass 
server blade enclosure, and four interconnect options. 

The ProLiant BL p-C lass server blade family includes the dual-processor ProLiant BL2 Op and BL20p G 2 
server blades for mid-tier applications and the quad-processor ProLiant BL40 p server blade for back- 
end applications. 

The 6U (10.5 inch) p-C lass server blade enclosure has eight server bays, and two outermost 
interconnect bays for collection of the network and storage signals. The signals are routed from the 
server blades, across the server blade enclosure backplane, and to the interconnect blades. 

HP offers a family of interconnect options so that customers can choose how the Ethernet network 
signals exit the server blade enclosure. Interconnect options include two patch panel pass-through kits 
and two integrated Ethernet switch kits (the GbE Interconnect Kit and the GbE2 Interconnect Kit). The 
two patch panel options allow all Ethernet network signals to pass through to third-party LAN devices, 
thus giving customers flexibility in choosing their own switches. The G bE and G bE2 Interconnect Kit 
options include managed Ethernet switching technology that provides up to a 32-to-l reduction in 
network cables at the back of the BL p-C lass enclosure. This cable reduction significantly reduces the 
time required to deploy, manage, and service ProLiant BL p-C lass systems. 

Please see the ProLiant BL p-Class N etworking 0 verview white paper for a summary of all four 
interconnect options along with an interconnect decision chart to assist in choosing the appropriate 
type of interconnect switch to use. 

This white paper describes the G bE Interconnect Switch. The G bE Interconnect Switch is intended for 
applications that require 100 megabits per second (M b/ s) Fast Ethernet network adapter (N IC) 
consolidation to G igabit Ethernet uplinks. 



1 Available at http:/ / hl8004.wwwl.hp.com/ products/ servers/ proliant-bl/ p-class/ bl-p-interconnect-sw itch, html . 
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G bE Interconnect Kit 



The G bE Interconnect Kit contains two redundant, hot-swappable G bE Interconnect Switches and two 
4-portLAN interconnect modules. Users first insert the LAN interconnect modules into the top-left and 
top-right interconnect bays at the rear of the server blade enclosure and then install the interconnect 
switches into the interconnect bays from the front of the enclosure (Figure 1). The G bE Interconnect 
Switches consolidate the 32 Ethernet ports from the server blades into one to twelve external ports: 
four G igabit Ethernet uplink ports (uplinks) and four 10/ 100T uplinks on the two LAN interconnect 
modules and four 10/ 100T ports on the front of the switches. If desired, users can configure the G bE 
Interconnect Kit to concentrate the 32 Ethernet signals into a single external Ethernet port (see the 
section titled "Maximizing network cable reduction"). 




M odular hot-swappable design 

To enhance the system serviceability and simply upgrades, both the G bE Interconnect Switch and the 
LAN interconnect modules are hot swappable. This modular design provides two key benefits: 

• The G bE Interconnect Switches can be quickly and easily removed and replaced from the front of 
the rack without the need for re-cabling. 

• Each G bE Interconnect Switch can support copper or fiber Ethernet network uplinks by using 
different LAN interconnect modules. 

Support for copper and fiber-based networks 

Two interconnect kit options are available: the C-G bE Interconnect Kit for copper-based networks and 
the F-G bE Interconnect Kit for fiber-based networks. These kits are identical with exception of the 
interconnect modules, which are described in the "Interconnect switch architecture" section. 

Interconnect switch architecture 

Each G bE Interconnect Kit provides an end-to-end, fully redundant architecture that maximizes 
network availability (Figure 2). Redundant network adapters are routed from each server blade bay to 
each hot-swappable interconnect switch (four N ICs total per server bay) creating a fully meshed 
topology to the external Ethernet network. The interconnect switches are cooled by on-board 
redundant fans and they are powered by two independent feeds via the redundant, N +N hot-plug 
ProLiant BL p-C lass power enclosure. 
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Users can independently disable or enable the switch ports as desired. Auto-M Dl/ M DIX with auto- 
negotiation of speed and duplex mode is supported. Each G bE Interconnect Switch includes the 
following Ethernet ports: 

• Sixteen dedicated internal 10/100 M b/ s Ethernet downlink ports connecting the server N ICs to the 
switch. 

• Six external Ethernet ports for data, interconnect switch A and B management, Integrated Lights-out 
(i LO ) management, and/ or pre-boot execution environment (PXE) remote configuration. 

- Two 10/ 100/ 1000T and two 10/ 100T uplink ports (C-GbE) or two 1000SX and two 10/ 100T 
uplink ports (F-G bE) on the rear-mounted LAN interconnect module. 

- Two 10/ 100T ports on the switch front panel. 

• Two dedicated internal 10/100 M b/ s Ethernet crosslink ports bundled as a multi-port trunk for 
switch-to-switch communication and failover, if desired. 

These Ethernet ports are described in the following subsections. 



Figure 2. ProLiant BLp-C lass G bE Interconnect Kit architecture 




*The ProLiant GbE Interconnect Switch GbE Interconnect Switch 

also supports Ihe BL40p server blade. ^ n ^ Konriec ^ gj 



Downlink ports 

Each G bE Interconnect Switch includes sixteen pre-assigned, internal 10/100 M b/ s Ethernet 
downlink ports connecting the server blade network adapters signals to the switch. The signals are 
routed as Ethernet from the server blades, across individual category 5e (CAT5e) specified signal 
traces on the passive backplane assembly of the server blade enclosure, and then to the switches. 

LAN interconnect module uplink ports 

The LAN interconnect module uplink ports are typically used to connect the interconnect switches to 
the network infrastructure; however, they are standard Ethernet switch ports and may be used as 
desired. The G bE interconnect kits are identical with exception of the LAN interconnect modules. The 
C-GbE Interconnect Kit includes two 0 uadT interconnect modules, each with two 10/ 100/ 1000T 
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and two 10/ 100T Ethernet ports all with RJ-45 connectors. The F-G bE Interconnect Kit includes two 
DualTSX interconnect modules, each with two 1000SX Ethernet ports with LC connectors and two 
10/ 100T Ethernet ports with RJ-45 connectors. Each interconnect module has an independent guide 
pin to ensure insertion alignment and a robust connector assembly to prevent it from being used with 
incompatible devices. 



Table 1. Interconnect modules used with the C-G bE and F-G bE Interconnect Kits 



Components 


C-GbE Interconnect Kit 


F-GbE Interconnect Kit 


Interconnect switches 


Two GbE Interconnect Switches 


Two GbE Interconnect Switches 


Interconnect modules 


Two Q uadT interconnect modules with: 


Two DualTSX interconnect modules with: 




• Two 10/ 100/ 1000 BASE-T/TX/T ports 


• Two 1000 BASE-SX ports 






• Two 10/ 100 BASE-T/TX ports 


• Two 10/ 100 BASE-T/TX ports 




• Four RJ-45 connectors with link speed 


• Two LC connectors and two RJ-45 




and activity LEDs. 


connectors with link speed and activity 






LEDs 











Front panel ports 

Two 10/ 100T external ports are conveniently located on the front panel. These front panel ports 
allow users to perform local management and diagnostic tasks without unplugging a dedicated 
uplink. This prevents disruption the production network to perform these tasks. See the "Serviceability 
and diagnostics" section for more details on the switch front panel. 

W hen the front panel ports are not used for local management, one or both ports may be used as 
additional uplinks. A channel is provided at bottom of each interconnect switch to allow network 
cables to be routed from the front to the rear of the rack, or vice versa. 

Crosslink ports 

The two G bE Interconnect Switches are connected through a pair of redundant, 10/100 M b/ s Fast 
Ethernet crosslink connections that are bundled in a 200 M b/ s C isco EtherC hannel compatible multi- 
port trunk. The signals are routed as Ethernet from switch to switch via individual CAT5e specified 
signal traces on the passive backplane assembly of the server blade enclosure. The crosslinks permit 
communication between the switches, if desired. They also provide the ability to: 

• M anage both switches, perform PXE server boots, and access all i LO interfaces using any number 
of external switch ports. Therefore, a single switch uplink can be used to perform all Ethernet 
management tasks. 

• Configure the p-Class system for advanced ProLiant N etwork Adapter Teaming including switch 
fault tolerance. See the section "ProLiant N etwork Adapter Teaming" for additional information. 

• Communicate with any server network adapter from any switch uplink port. As a result, any single 
uplink port may be used to communicate to all 32 N ICs. This permits the 32-to-l cable reduction 
and provides additional system redundancy. If uplinks on one switch or the connection to a switch 
were to fail, all N ICs still can be accessed via the other switch. 
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Maximizing network cable reduction 



For maximum (97 percent) cable reduction, the 32 Ethernet signals within the server blade enclosure 
can be concentrated into any one single external Ethernet port. This results in a total of seven Ethernet 
connections for a fully configured 42U rack of six server blade enclosures containing 192 network 
adapters. 

Applications that utilize a single uplink port include testing and evaluation systems, server blade 
enclosures with a few installed servers, and applications that require minimal bandwidth. 0 n a 
heavily utilized system, using a single uplink port for all 32 network adapters can cause a traffic 
bottleneck. For example, using one uplink from interconnect switch A requires the traffic from all the 
network adapters routed to switch B to travel over the two crosslinks (a 200 M b/ s path), previously 
shown in Figure 2. The crosslinks are intended primarily as a failover route and generally are not 
used as a primary path. For more optimal performance, at least one uplink port on each interconnect 
switch would be used. However, system administrators may use any combination from one to all 
twelve external Ethernet ports to increase bandwidth, to separate network and management data onto 
physically isolated ports, or to add redundant connections to the Ethernet network backbone. 

Another means to achieve network cable reduction is to link the G bE Interconnect Switches with other 
ProLiant BL e-C lass and p-C lass interconnect switches from different server blade enclosures. This is 
ideal for customers with multiple blade enclosures within a rack. It also allows the network 
administrator to define the desired level of network blocking or oversubscription. 

For example, Figure 3 shows a configuration with three fully populated BLp-Class server blade 
enclosures, each with the C-G bE Interconnect Kit installed. The interconnect switches are linked, or 
daisy chained, together in redundant configuration using the four gigabit uplinks that, in turn, are 
connected to the Ethernet network backbone. Each enclosure contains thirty-two 10/100 Ethernet 
network adapters with an aggregate bandwidth of 3.2 gigabits per second (G b/ s), for a total 
bandwidth of 9.6 G b/ s for entire system of three enclosures. However, since uplinks are daisy 
changed together, the maximum system throughput for this configuration is 4.0 G b/ s (the combined 
throughput of the four daisy chained gigabit ports). This configuration creates a 2.4x blocking ratio 
(9.6 G b/ s versus 4.0 G b/ s); nevertheless, it reduces the total Ethernet network cables atthe rack level 
from 96 to 4, a 96 percent cable reduction, while maintaining redundant connections to the Ethernet 
network backbone. 



Figure 3. ProLiant BLp-Class G bE Interconnect Switch linking 




In this example, four gigabit uplinks per server blade enclosure were used. Because the two G bE 
Interconnect Switches provide a total of twelve external Ethernet ports per enclosure, a wide variety of 
linking configurations are possible. Additionally, the two interconnect switches within each enclosure 
are connected by redundant crosslinks, which provide additional configuration possibilities. 

N etwork load balancing 

ProLiant BL systems configured with the interconnect switch support three network load balancing 
solutions. 0 ptions exist for providing this functionality integrated within or exterior to the server blade 
enclosure. 

For load balancing within the server blade enclosure, the F5 N etwork BIG -IP Blade Controller (BIG -IP) 
may be used. BIG -IP is a software option for ProLiant BLe-C lass and p-C lass systems that provides a 
very economical solution to load balancing and traffic management between multiple server blades 
that reside in a single to multiple server blade enclosures. 

BIG -IP is available from F5 N etworks as a software option installed on ProLiant server blades. 0 ne 
license is installed on a server making the server blade into a "dedicated" load balancer; no 
additional software can be installed on the server blade. For a redundant solution, two copies of BIG - 
IP are installed on two server blades. The server blade(s) with BIG -IP installed may perform load 
balancing on blade servers that reside in the same or different server blade enclosures, both e-C lass 
and p-C lass. The blade servers may be located anywhere on the network as long as load balanced 
traffic to and from the servers pass through the BIG -IP Blade Controller. For more information on BIG- 
IP Blade Controller for ProLiant BL systems, see http:// h71028.www7.hp.com/enterprise/ html/ 455 7- 
0-0-0-121.html . 

For load balancing exterior to the server blade enclosure, a third party layer 7 Ethernet switch or 
network load balancing appliance may be used. This traditional approach uses a multi-tiered 
architecture where the interconnect switches are connected to one or more layer 7 switches or 
network load balancing appliances. Layer 7 switches and network load balancing appliances are 
available from several network vendors including Cisco, F5, N ortel, and others. This solution is 
supported on both e-C lass and p-C lass configured with any interconnect kit. 

Investment protection 

The G bE Interconnect Kits are fully supported in the p-C lass sever blade enclosure with any 
combination of ProLiant BL20p, BL20p G 2, and BL40p server blades. Users can upgrade to the G bE 
Interconnect Kit from existing RJ-45 Patch Panel and RJ-45 Patch Panel 2 Kits without powering down 
the server blade enclosure or server blades. 

Switch management 

The G bE Interconnect Switch is an industry-standard managed Ethernet switch, which means that users 
configure and manage the switch like other industry-standard Ethernet switches. To aid users during 
initial deployment, the G bE Interconnect Switch includes a default configuration that is fully 
operational at initial boot. 

A web browser-based interface (BBI), menu driven console interface (MDI), and a command line 
interface (CU) with scripting capability are pre-installed in the switch firmware to configure, manage, 
and monitor the interconnect switch. The interconnect switch also supports Telnet access, simple 
network management protocol (SN M P), and remote monitoring (RM 0 N ). Any combination of the 
downlinks, crosslinks, and external ports can be disabled, enabled, configured, and monitored on a 
per port basis. 0 utof-band and in-band access to the switch management interfaces are supported 
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locally and remotely from anywhere on the network. Administration of both G bE Interconnect 
Switches is possible through any uplink port, the serial port, or the two 10/ 100T ports conveniently 
located on the front panel of each switch (Figure 4). 



Figure 4. ProLiant BL p-C lass G bE Interconnect Switch front panel 




LED panel for link speed 
and activity status per port 



power and management status LEDs 

Two local access 10/IOOT 
Ethernet switch ports 
RJ-45 connector link speed 
and activity LEDs 

DB-9 serial connector for access to 
the CLI and menu driven console 

power/ reset button 

blade chassis latch 
and handle 



Rapid deployment back-up, and restore 

HP Rapid Deployment Pack for W indows version 1.40 or greater (RDP for W indows) introduces a 
new feature called server-side scripting. W ith server-side scripting, interconnect switch scripts can be 
integrated in an RDP for W indows job for deployment of both blade servers and switches. This is 
ideal for using RDP for W indows to deploy a blade server and then configure associated switch 
VLAN s; however, any scriptable interconnect switch parameter can be integrated. 2 

HP Rapid Deployment Pack for W indows version 1.40 includes A Itiris Deployment Solution version 
5.6 (A Itiris v5.6). Altiris v5.6 provides a "Switch Add-on" utility that identifies and manages VLAN 
settings on the G bE Interconnect Switches. A utility's W indows 32-bit graphical interface displays a 
tabular view of the all switches that have been identified, along with their respective switch ports, 
switch description, and VLAN assignments. 

Using either the supported W indows graphical interface or the command line interface, an 
administrator can: 

• View the G bE Interconnect Switch M IB (M anagement Information Base) system information via 
SN M P version 1. 

• View the G bE Interconnect Switch ports and the VLAN setting for each port. 

• Add/ delete a G bE Interconnect Switch device to/ from the database. 

• M odify the VLAN setting of a G bE Interconnect Switch port via script configuration changes using 
the CLI or manually using the W indows graphical interface. 

• Assign physical connectivity of a discovered device to a switch port (W indows interface only). 



For more information, see the white paper Using ProLiant Essentials Rapid Deployment Pack for scripted blade-based switch configuration at 
http:// hl8QQ4.wwwl.hp.com/ products/ servers/ proliant-bl/ p-class/ bl-p-interconnect-switch.html . 
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The G bE Interconnect Switch supports trivial file transfer protocol (TFTP) allowing a copy of the 
interconnect switch configuration file to be saved and downloaded either to the original switch or to a 
different interconnect switch. This provides a method to rapidly deploy multiple systems with similar 
configurations and to provide backup and restore capabilities. Configuration settings can be modified 
through the user interfaces or directly within the configuration file. The configuration file has an 
extensible markup language (XM L) format, which allows it to be directly viewed, printed, and edited. 
The configuration file may even be reset to the factory default settings at any time. 

Users can perform firmware operating system upgrades by using TFTP through any external Ethernet 
port after boot-up, and by using ZM odem through the serial interface during boot-up. The interconnect 
switch simplifies system upgrades by retaining its configuration after a firmware upgrade and by 
supporting the HP Support Paq automated firmware upgrade process for W indows deployment 
stations. 

IP addressing 

Users can configure the G bE Interconnect Switch to automatically obtain an IP address from a 
dynamic host configuration protocol (DHC P) or bootstrap protocol (BO 0 TP) server or they can 
manually assign an IP address through the command line and menu-driven console interfaces. Users 
can also assign an IP address from the BBI; however, they would have to reconnect with the newly 
assigned IP address. For increased security, an administrator can specify the IP-based management 
stations that are allowed to access the interconnect switch. 

Web browser-based interface 

Users can access the BBI by using Internet Explorer or N etscape N avigator over a TC PI IP network 
(Figure 5). The BBI interface consists of three main sections: 

• The Active Virtual G raphic provides real time status of the switch front panel and provides the 
means to quickly view statistics of individual ports. 

• The N avigation W indow contains particular items or features to select. 

• The Administration W indow contains options for viewing or altering G bE Interconnect Switch 
information. 
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Menu-driven console and scriptable command line interface 

The menu-driven console and the command line interfaces provide the same configuration options as 
the BBI, plus the added benefits of an out-of-band connection and CLI scripting (Figure 6). 

There are three methods of accessing these interfaces: 

• Locally via the front panel RS-232 console port on each interconnect switch. 

• Remotely using serial line IP (SLIP) via the front panel RS-232 console port on each interconnect 
switch. 

• Remotely using a console Telnet session via any interconnect switch external Ethernet port. 



Figure 6. Command line interface for ProLiant BL p-C lass G bE Interconnect Switch 











State:-=Enabled > Speed/Duple* : <JLut □ > Flow Control: <0 ff > APPLY 






P£ Type ULAN Wane Port Bane State Settings Connection 










.AEL _ _ Jif = U 
















1 








CTPL4T Boot 












Act i on ; 'B^BiBEtK^? 




i 




BID State Age Out Querier State 








Age Out - Bobustness Variable * Query Interval + Bax Pesponse 















Simple network management protocol and remote monitoring 

The G bE Interconnect Switch supports industry-standard SN M P management information bases (M IBs), 
HP enterprise switch M IBs, environmental traps, and RM 0 N groups 1 (statistics), 2 (history), 3 
(alarms), and 9 (events). The SN M P agents are pre-installed in the interconnect switch firmware. Four 
community strings and SN M P trap manager hosts can be configured per switch. An interconnect 
switch SN M P scripting utility and HP recommended example scripts are included. 

This capability allows the interconnect switch to be monitored remotely from an SN M P/ RM 0 N 
network management station such as Insight M anager 7 3 or H P 0 penView . 4 The interconnect switch 
may also be configured through the HP 0 penView N etwork N ode M anager. The unique interconnect 
switch integration with Insight M anager 7 provides the following additional features: 

• Pre-registered (compiled) G bE Interconnect Switch M IBs. 

• Automatic discovery and identification of the interconnect switches upon registration of M IBs. 

• Automatic receiving of traps and events from the interconnect switches upon registration of M IBs. 



3 Available at http:/ / www.compaq.com/ products/ servers/ management/ cim7 -description. html . 
' Available at http:/ / www.hp.com/ products!/ softwareproducts/ software/ openview/ index.html . 
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• G raphical representation of the p-Class server blades and interconnect switches. 

Switch security 

The G bE Interconnect Switch uses a layer 2 access control list or filtering database to segment the 
network, control communications between segments, and provide intrusion control. The switch allows 
manual entry of specific media access control (MAC) addresses to be filtered from the network. 
Filtering of both unicast and multicast traffic is possible. The maximum number of M AC addresses 
learned on a per port basis may further be restricted. 

Several additional features are provided on the G bE Interconnect switch to allow the switch 
administrator to secure the management interfaces. These features include the ability to: 

• Configure multiple password protected accounts with various levels of access. 

• Specify the IP-based management stations that are allowed to access each switch. 

• Seta user interface idle time-out period. 

• Disable web-based and Telnet access. 

• Configure port-based IEEE 802. 1Q tagged VLAN s for server grouping and data isolation. 

Serviceability and diagnostics 

The G bE Interconnect Switch has several serviceability features such as the front-mounted, hot- 
swappable interconnect switch blade, and the front panel RS-232 port, Ethernet ports, and a power 
re-set switch. The interconnect switch also has system status LEDs and a LED annunciation panel that 
displays the link speed and activity status for each port (Figure 7). 



Figure 7. Front port LED panel for ProLiant BLp-C lass G bE Interconnect Switch 




o © 



link speed LED: 



amber = 1000 Mb/s 
green =100 Mb/s 



6ff 



10 Mb/s 



link activity LED: green - link and no activity 

green (lashing - link and activity 
amber = port disabled 

off = no link 




Server blade Ethernet port link 
and activity speed (ports 1-16) 



Crosslink port link and activity speed 
(ports 17-18) 

10/lOOT uplink port link and 
activity speed (ports 1 9 - 20) 

10/100/1000T(or 1O0OSX) 
uplink port link and activity speed 
(ports 21-22)* 



'Uplink ports 21 and 2 2 on the p-C lass C-G bE Interconnect Kit are 10/ 100/ 1000T. 
Uplink ports 21 and 22 on the p-C lass F-GbE Interconnect Kit are 1000SX. 
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The optional HP Diagnostic Station (Figure 8) is available to configure and diagnose an interconnect 
switch or a server blade that has been removed from the server blade enclosure. The Diagnostic 
Station provides power to the interconnect switch and can be used to perform any of the following 
tasks: 

• Build the initial interconnect switch configuration. 

• Download a switch configuration file. 

• Test network adapter and interconnect switch port activity. 

• Diagnose interconnect switch status. 

• Test an interconnect switch after installing an option or upgrade. 



Figure 8. Diagnostic Station 




The G bE Interconnect Switch provides many additional serviceability and diagnostic features 
including: 

• Port mirroring with the ability to mirror desired type of frames (egress, ingress, or both. 

• Power on self test (PO ST) at boot for hardware verification. 

• M onitoring screens via the user interfaces for port utilization, data packets received/ transmitted, 
error packets, packet size, trunk utilization, SN M P data, etc. 

• Details of system information via the user interfaces such as port parameters and link status, switch 
asset information, configuration values, log entries, etc. 

• The ability to "ping" to test the connectivity on the Ethernet network. 

• Local system log (syslog) with ability to view and clear messages that may be saved (uploaded) as 
text file via TFTP. 

• MAC addresses view, clear, and delete from the forwarding database for identifying problems with 
MAC address learning and packet forwarding. 

• The ability to set the interconnect switch to a valid firmware image in case of firmware corruption. 

For more detailed information on the administration capabilities of the ProLiant BL p-C lass G bE 
Interconnect Switch, see the ProLiant BL p-C lass G bE Interconnect Switch user guides. 5 

Virtual LAN 

The G bE Interconnect Switch supports 256 port-based IEEE 802. 1Q virtual LAN s (VLAN s) with GVRP 
dynamic VLAN registration 6 . M embers of a VLAN may be untagged and tagged ports according to 
IEEE 802. 3ac VLAN Ethernet frame extensions for 802. 1Q tagging. Therefore, G bE Interconnect 



5 Available at http:/ / hl8004.wwwl.hp.com/ products/ servers/ proliant-bl/ p-class/ bl-p-interconnect-sw itch, html . 

6 GVRP stands for GARP VLAN Registration Protocol. 
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Switch VLAN s may span other switches that support 802. 1Q tagging located within the network 
infra structure. 

Spanning tree 

The G bE Interconnect Switch meets the IEEE 802. ID spanning tree protocol (STP). Users can 
configure STP switch parameters, including priority and cost, on a per port basis. Each interconnect 
switch can automatically find the STP root bridge on the network. 0 therwise, the interconnect switch 
will act as the root bridge for the STP domain. 

For networks designed without loops or individual switch ports connected to server blades or other 
devices where a loop does not exist, the G bE Interconnect permits STP to be: 

• Disabled on a per switch or per port basis. 

• Placed in a bypass mode (Cisco PortFast equivalent) on a per port basis allowing a port to skip the 
standard STP modes and enable itself directly in the forwarding state. 

EtherChannel compatible link aggregation 

The G bE Interconnect Switch complies with IEEE 8 02.3 ad static link aggregation (excluding LAC P 7 ) 
compatible with Cisco EtherChannel (Fast EtherC hannel, G igabit EtherC hannel). Each GbE 
Interconnect Switch supports six multi-port trunks with up to eight ports per trunk. 

Internet group management protocol 

The G bE Interconnect Switch provides internet group management protocol (IG M P) snooping vl and 
v2, configurable to a non-querier mode. The IG M P state may be enabled and disabled on a per 
VLAN basis as well as a configurable response report delay and query interval. The G bE Interconnect 
Switch allows a maximum of 191 concurrent multicast groups (127 dynamically learned by IG M P, 64 
static multicast). 

Data storm prevention 

The G bE Interconnect Switch permits configurable thresholds (in packets per second) to prevent three 
types of packet storms: broadcast, multicast, and destination address (DA) unknown. If the threshold is 
exceeded, any additional packets received would be dropped. 

Q uality of service 

Support for quality of service (0 oS) IEEE 802 .lp on the GbE Interconnect Switch allows switch 
administrators to set priority levels on each switch for forwarding packets. Each switch supports four 
classes of traffic (buffers or queues) for implementing priority based on the priority tag of the packet. 
Administrators can map up to eight priority levels to four classes. Traffic from a specific server port 
can be given priority over packets from other devices according to this range of priority levels. For 
example, with multiple packets in a buffer, the packet with the highest priority would be forwarded 
first, regardless of when it was received. 

Enterprise-class performance 

The GbE Interconnect Switch includes the following performance features: 

• N onblocking, full wire speed on all ports. 

• 9.6 G b/ s external port bandwidth per server blade enclosure (full duplex). 

• 7.2 million packets per second maximum external port frame forwarding throughput per server 
blade enclosure (64-byte packets). 

• 8,191 MAC addresses per switch with automatic MAC address learning. 

7 Link Aggregation Control Protocol. 
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• 32-MB Main, 6-M B flash, and 16-M B packet buffer memory per switch (packet buffer memory 
shared between ports). 

ProLiant N etwork Adapter Teaming 

ProLiant N etwork Adapter Teaming is typically used to provide fault resiliency for the N ICs within the 
team. If one N IC should fail, the surviving N ICs maintain network connectivity. However, network 
adapter teaming may also be used to maintain network services if an Ethernet switch fails. The 
architecture of the p-Class system allows for both network adapter and interconnect switch fault 
tolerance when using ProLiant N etwork Adapter Teaming. 

The ProLiant p-C lass servers include standard H P N C series network adapters that support all three 
types of ProLiant N etwork Adapter Teaming: 

• N etwork Fault Tolerance (N FT) 

• Transmit Load Balancing (TLB) 

• Switch-assisted Load Balancing (SLB) 

W hen teaming H P N C series network adapters with the interconnect switch, N FT and TLB teaming are 
the same as with any ProLiant system. However, for SLB teaming, the pre-defined switch-to-server 
architecture across the server blade enclosure's backplane must be considered. SLB requires that all 
N ICs in the team must be connected to the same switch. 

The G bE Interconnect Switch's redundant crosslinks add significant advantages when configuring 
teaming for switch fault tolerance. For details, see the H P ProLiant network adapter teaming white 
paper 8 located on the ProLiant teaming home page. 

Conclusion 

The ProLiant BL p-C lass system is a comprehensive solution for customers operating multi-tiered 
environments that demand space and power efficiency, on-demand computing, end-to-end system 
redundancy, rapid hardware and software deployment, and scalable management. The ProLiant 
p-C lass G bE Interconnect Kits are part of the family of interconnect options available for the ProLiant 
BL p-Class system. Each G bE Interconnect Kit includes a pair of fully redundant, managed Ethernet 
switches that consolidate up to thirty-two network adapters (at a maximum of 10/ 100 M b/ s) to one to 
twelve external ports. These options are ideal for reducing Ethernet network cabling and the time 
required to deploy, manage, and service ProLiant BL p-C lass systems. 



Available at ftp:/ / ftp, Compaq, com/ pub/ products/ servers/ networking/ TeaminqW P.pdf . 
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Appendix: Summary of features of the ProLiant BL p-Class 
G bE Interconnect Kit 



Switch performance 

• Non-blocking full wire speed architecture 

• Store and forward mode layer 2 switching standard 

• Support for 3rd party external layer 7 content delivery switch / appliance 

• Support for F5 BIG -IP Blade Controller load balancer and traffic management 

• Frame forwarding throughputof 1.488 million packets per second (per G igabit port) 

• Frame forwarding throughputof 0.1488 million packets per second (per Fast Ethernet port) 

• 7.2 million packets per second maximum external port (uplink) frame forwarding throughput per server blade enclosure (64- 
byte packets) 

• 9.6 G b/ s External port (uplink) bandwidth per server blade enclosure (full duplex) 

• 32 M B M ain, 6MB flash, and 16 MB packet buffer memory per switch (packet buffer memory shared between ports) 

• Auto-negotiation and auto-sensing with full-duplex support and ability to manually force port speed and duplex mode 

• Auto-M Dl/ M DIX on all ports enabled with auto-negotiation 

• 8,191 MAC addresses per switch with automatic MAC address learning 

• ARP for IP to MAC address resolution 

Switch network features 

• IEEE 802.3 lOBase-T Ethernet IEEE 802. 3u 100Base-TX Ethernet, IEEE 802. 3ab lOOOBase-T Ethernet and IEEE 802. 3z 
lOOOBase-SX 

• IEEE 802. ID spanning tree protocol (mono-spanning tree) 

• Spanning tree bypass fast forwarding mode on a per port basis (Cisco PortFast equivalent) 

• Enable/ disable and configure spanning tree port cost and priority on a per port basis 

• IEEE 802 .3 ad link aggregation (excluding LA CP) supporting up to 6 multilink trunk groups with 8 ports per group; 
compatible with Cisco EtherChannel blinking (Fast EtherChannel, G igabit EtherChannel) 

• 256 IEEE 802. 1Q port based VLAN s per switch 

• IEEE 802. 3ac VLAN Ethernet frame extensions for 802. 1Q tagging on a per port basis 

• Tagged and untagged ports as members of a VLAN 

• GARPVLAN registration protocol (GVRP) providing 802. 1Q compliant VLAN pruning and dynamic VLAN creation 

• IEEE 802. lp QoS with 4 classes of service mapped to 8 priority levels 

• IG M P snooping vl and v2, configurable to a non-querier mode 

• IG M P state enabling and disabling on a per VLAN basis 

• IGMP response report delay and query interval configuring 

• 191 M aximum concurrent multicast groups (127 dynamically learned by IG M P, 64 static multicast) 

• Broadcast, multicast, and unknown packet storm control with a configurable threshold value 

• IEEE 802. 3x flow control with manual configuration capability 

• Primary and secondary SN TP (simple network time protocol) server with time zone support and automatic daylight savings 
adjustment 

Switch deployment and configuration 

• Supports any combination of ProLiant BL p-C lass server blades 

• Default pre-config uration for immediate plug-in operation in the server blade enclosure 

• Communicate to any and all server blade network adapters from any Ethernet external port 

• Manage both switches, access all iLO ports, and execute PXE from any external Ethernet port 

• Web-based interface accessible from any switch Ethernet port 

• Menu driven console interface accessible from any switch port 
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• Command line interface (C U) with scripting capability accessible from any switch port 

• Telnetaccess to the CU and menu-driven console interfaces accessible from any switch port 

• SNMP-based scripting with best-case H P recommended example scripts 

• Integrated switch scripting within Rapid Deployment Pack for W indows vl. 40 or greater 

• Altiris Switch Add-on utility in Rapid Deployment Pack for W indows vl.40 or greater 

• 0 ne serial and two Ethernet ports conveniently located on the front of each switch for additional uplinks and local 
management, port mirroring, and other administration and diagnostic tasks 

• Serial line IP (SLIP) access to command line and menu-driven console interfaces 

• Configurable forwarding M AC address aging time settable to any value from 1 to 1 million seconds (default is 300 seconds) 

• MAC address user management sorting on a per portand perVLAN basis 

• M anual (static) entries in M AC address table 

• M anual, or automatic IP settings via a DHCP or BO 0 TP server 

• Ability to restore switch to factory default settings 

• TFTP to upload and download (save, restore, and update) the switch configuration file 

• TFTP to upload and download (save, restore, and update) the switch firmware 

• ZModem to download the switch firmware (restore and update) via the serial interface 

• Switch configuration retention after firmware upgrade 

• HPSupportPaq automated firmware upgrade process for W indows deployment stations 

• Human read/ write configuration file for viewing, printing, and editing 

• Pre-configured customized port naming with respect to server blade NIC connectivity 

• Per port bandwidth control of ingress and egress traffic 

• Ability to name ports on a per port basis 

• Full ability to enable and disable any port (both internal and external ports) on both switches 

Switch diagnostics and monitoring 

• O ne serial portand two Ethernetports conveniently located on the front of each switch for additional uplinks and local 
management, port mirroring, and other administration and diagnostic tasks 

• Front panel per port speed and per port link activity LED annunciation panel per switch 

• System and management status LEDs 

• Per port speed and link activity LEDs adjacent to all external Ethernetports 

• Active virtual graphic in the web-based switch interface 

• Port mirroring with ability to mirror desired type of frames (egress, ingress, or both) 

• Switch statistic monitoring including port utilization, data packets received/ transmitted, port error packets, packetsize, trunk 
utilization, SN M P data, etc 

• System reporting such as port parameters and link status, switch asset information, configuration values, log entries, etc. 

• Ping capability to test the connectivity on the Ethernet network 

• SN M P vl with four configurable community strings and SN M P trap manager hosts 

• M IB-II, Bridge M IB, Interface M IB, Extended Bridge M IB, Ethernet-like M IB, Entity M IB, and HP enterprise switch M IBs 

• Bridge, remote monitoring, and switch environmental traps 

• Pre-registered (compiled) switch M IBs with Insight M anager 7 

• Insight M anager 7 automatic discovery, identification, and receiving of traps and events 

• Insight M anager 7 graphical representations of switches 

• Insight M anager 7 standard database activities (queries, tasks, reporting, etc) 

• Power on self test (PO ST) atbootfor hardware verification 

• Portable Diagnostic Station to configure, upgrade, and diagnose an interconnect switch and server blade removed from the 
rack environment 

• Ability to return switch to a valid firmware image in case of firmware corruption 

• Local system log (syslog) with ability to view and clear messages, and save (upload) as text file via TFTP 
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Switch security 

• Password protected multi-level user accounts supported on all management interfaces 

• Configurable user interface idle time-out period 

• Ability to disable web-based and Telnet access to the switch user interfaces 

• 256 Port-based IEEE 802. 1Q tagged VLAN s per switch (5 12 per server blade enclosure) 

• Ability to specify the IP-based management stations thatis allowed to access the switch 

• Unicastand multicast static MAC address packet filtering table (layer 2 access control list) 

• Restriction on the maximum number of M AC addresses learned on a per port basis 

Switch availability 

• Front-mounted, hot-swappable switch with configuration retention and no need to cable/ recable when removing 

• Redundant switches per server blade enclosure 

• Redundant uplink ports per switch 

• Redundant frontpanel management diagnostic ports per switch 

• Redundantcrosslinks for switch to switch communication and failover scenarios within the server blade enclosure 

• Redundant pairs of network adapters per server routed to different switches 

• Redundant N +N hot-plug redundant power to each switch 

• Redundant N +1 on-board cooling per switch 

• IEEE 802 .3ad automatic multi-link load balancing and link failover (excluding LACP) 

• Load balancing of unicast traffic 

• ProLiant network adapter teaming 

• Redundant configurable community strings and SN M P trap manager hosts 

• Redundant configurable SNTP servers 

Switch ports per server blade enclosure 

• Four external 10/ 100T Fast Ethernet ports and four external 10/ 100/ 1 000T (C-GbE)or 1000SX (F-G bE) G igabit Ethernet 
ports, all on a pair of hot-pluggable rear-mounted interconnect modules 

• Four external 10/ 100T Fast Ethernet ports on switch front panels 

• Two external DB-9 serial ports on switch front panels (one per switch) 

• 32 internal 10/ 100 Fast Ethernet ports to server blade network adapters (4 per server bay) 

• Two internal 10/100 G igabit Ethernet inter-switch crosslinks for switch to switch communication and failover scenarios 

• l 2 C Switch to management module communications 

• All external Ethernet ports may be used for data, switch and iLO management, and/ or PXE remote configuration. 

• All internal Ethernet signals routed as Ethernet across individual CAT5e signal traces 

• 12 RJ45 (C-GbE)or4 LC fiber + 8 RJ45 (F-G bE) external Ethernet port connectors 

Switch physical and environmental 

• AC power input (at server blade system level) 

• Direct facility 48 DC power input 

• 40 Typical and 50 maximum power consumption per switch (watts) 

• Local front power reset/ power cycle button on each switch 

• Remote reset/ power cycle via user interface 

• 10 to 35 operating and -30 to 60 storage temperature (Celsius) 

• 20% to 80% operating and 5% to 95% storage relative humidity 

• FCC ClassA, ICES-003 ClassA, AS/NZS 3548 ClassA, and VCCI ClassA electromagnetic interference (EM I) certifications 

• UL/ CUL and CE safety certifications 

• 11.5 pounds per interconnect switch and interconnect module 
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For more information 



For additional information, refer to the resources detailed below. 



Resource description 


Web address 


ProLiant BL p-C lass G bE 

Intorrn nnorf cuvitoh hnmo narid 

1 1 1 LCI LU 1 1 1 1 CL L jVV 1 LL 1 1 1 1 U 1 MC yJ a y C 


http:/ / hl8004.wwwl.hp.com/ products/ servers/ prolia nt-bl/ p-class/ bl-p- 


i ntarrn n norfcjctm i toh hhnl 

1 II LC 1 L U II II C L Lb VV 1 LL 1 1 . 1 1 LI 1 1 1 


ProLiant BL p-C lass N etworking 

\J VCIVICVV Will LC |J □ [J C 1 


http:/ / hl8004.wwwl.hp.com/ products/ servers/ prolia nt-bl/ p-class/ bl-p- 


i nta rm n norfc^w/ itr h h tml 

1 1 1 Lcl LU 1 1 1 IcLLiVV 1 LLI 1 . 1 1 U Ml 


Using ProLiant Essentials Rapid 


http:/ / hl8004.wwwl.hp.com/ products/ servers/ prolia nt-bl/ p-class/ bl-p- 


rionln\/monh Pari; - fnr crrintorl 
L>c|jiuyiiiciiL r □ l is. iui sl i i [j lcu 


i n to rrn n norfc-cuw i to h h hnl 

II llnl LU 1 1 1 1 CL L bvv \ LLI 1 . 1 1 U Ml 


blade-based switch 




configuration white paper 




ProLiant BL p-C lass GbE 
Interconnect Switch user guides 


http:/ / hl8004.wwwl.hp.com/ products/ servers/ prolia nt-bl/ p-class/ bl-p- 


interconnect-switeh.html 


ProLiant network adapter 
teaming 


http:/ / www.compaq.com/ products/ servers/ networking/ teaminq.html 




F5 BIG -IP Blade Controller for 
ProLiant BLsystems 


http://h7102 8.www7.hp.com/entErprise/ html/ 4557-0-0-0-12 l.html 
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